# GPT2 architecture

GPT-2 is an open-source language model developed by OpenAI, based on the Transformer architecture, capable of generating coherent text.

This is a small GPT2 model trained on the MC4 Sinhala language dataset, suitable for Sinhala text generation tasks.

A Traditional Chinese GPT2 model developed by Academia Sinica's CKIP team, suitable for Chinese text generation tasks.

GPyT is a GPT2 model trained from scratch on 80GB of pure Python code, focusing on Python code generation tasks.

This is a Spanish language model based on the GPT-2 architecture, trained using web-crawled data from the Spanish National Library between 2009 and 2019.